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ABSTRACT . ^ . , . ; • . 

This paper describes the continued 'development of th.e 
"Trouble SHWoting" Checklists, These checklists are ijased on^change 
a^nt responses^'and ?ire -designed to, be predictive of an institution's 
change potential for the adoption of innovations,, The development of 
two new instruments is described^ both innovatiori-freel. Ope applies' 
to higher educational settings^ while the other ''applies to 
schoolrbased settings/ As in the earlier, innovation-specific forms^ 
the new fotms are divided into distinct information areas andi 
identify the ideal' situatio^>. ^etginally acceptable and unacce*^ 
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I The "Trouble Shooting" Checklists Revisited: The Development of N^w Innovation-Pr^e ^ 
Check*! ists to Measure Change Potential in Higher Educational and School-Based Settings . 

Brad A.- Manning' * . ^ 

• A paper presented to -Ther AERA J^eti ng " ^ ^ 

Washington, D; C. , March 30-Aprl 1^, 1975 

The "Trouble Shoot! ng"^Check I i sts have been developed to assist educationr 

a! change agents and administrators, concerned with change, in t^eir assessment 

« 

^ of organizational" variables predictive of an institutiori's potential for sue-- 
CQ^sful ly adopting innovations. Two previous experimental checklist^, the TSC-A 
and the TSC-B (l^nningf 1973, 1974), were limi.ted to hig^her educational settings 
anci were innovation-specific? in that they focused on institutions adopting rpocl- 
ules and personal assfessment feedback systems (PAF) with a courTseling orienta- 
tion. Two new, experimen-|al "Trouble .Shooting" Checklists have now beef) designed ^ 
which are innovation-free and which are* predi cti ve of instit^utional change po- 
tential in higher educationa^l and school-based settings, . ' . ^ 

The6re*Kcal Framework 



Tiie*"Troub le Shooting" Checklists have been developed in conjunction with^ 
a project which has as its theoretical framewo^k a concerns-based adoption model 
(Hall, 1974; Hall, Wallace-, & Dosse-|-t, 1973) • In brief, the concerns-based a- 
doptlon model orders the effects of stages of human concern In interaction with 
levels of use of an innovation* The ordering is a developmental one which pos- 
tdates that both stages of concern and levels of use become' progress ivel^y more 
sophisticated throughout the adoption-implementation procesjs. The relationship 
of the TSC to the concerns-based adoption model is based on the assumption that 
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in order ^ar stages of concern and levels of use to develop progressively through 

1 ^ • 

the adopt^n-dl f f usi on process, an institution must meet certain donditions and 
be in an appropriate state of readiness. ' ^ 

All forms of the TSC^denti'fy for the administrator or the change agent 
both J deal and unacceptab le . organizational variables related to the adoption and 
implementat'Lon of innovations (the earlier TSC forms .also' identi ft ed marginal 
variab les^) . * ! n, order *to .make 'such an assessment, the "Troub-le Shoot i ng'^. Check- » 

lifets have been based on the assurr>ption. that the fol low.ing dimensions are crucial 

•» 

"* • • • ' 

the. general orgarti zational structure of the, i nst i tution; the descripti ve charac- 

teristiCs of its meinbers an-d the organizational climate;* personality, .leadership 

styles and concerns, of its memoers; the nature of comnjun ideations which occur y 
» * - * 

both with'in and without the institution; the levels at which previous innovations 
* 

have been used; and, the personality and. social characteristics of the students. 
♦ . / • 

The I nn ovation- Free form of the 'TSC 
for Hi gher-Educati ona I Settings 

The development of the original TSC-A and the TSC-B has been documented'. 
irT detail in'both the TSamanual, (Manning, 19.73) and a 1974 AERA paper (Mannina, ^ 
1974)., In brief,^a twgpty-riine page, open-ended questionnaire was given to* six 
change agents. This questionnaire was broken into idefal, marginal, and unac- 
ceptab I e question) area^. The' responses to this questionnaire served as a data 
ba|ie for the two ori.ginal checklists (TSC-A and TSC-B). After a series ^of re- 
writings and, refinements, 'these responses gradually became checklis^^ iteftis_. 
They were arbitrarily afssi gned^score values of 2, I, and 0 for items classified 
as (deal, marginal and. uraacceptab le, respectively. 



' Jhe innovation^f ree form of the TSC for higher education, was built direct- 

' ly fil5m the TSC-A and the TSC-B. The first step^was the eiimi nation of 5II- item^ 

which'^specif ical ly referred to modules, counseling or assessment batteries, as 

w^l! as i*tems which had any Innovation-specific reference. The, remaining Items 

were then exami'ned for their appropriateness in each subscale, * Since the TSC-B 

had Items in common with the TSC-A, these items were eliminated, .The remaining 

items were pooled^ to form the new Instrument. The next step was t© modify scale , 

and subscaTe titles In order to make them applicable to all departments -In hlgh- 

' er educational Institutions. As a result of these modifications, one subscale 

' . ' • ^• 

was eliminated. \v its place another subscale was built from the TSD informa- 

' ' ' , tion base.. ' . • , ' ' . 

This first experimental, innovatJ on-free form of the. TSC for higher educa- 

""tionai* institutions consisted of 495 items organi^zed Into 16* subscales Tn 5 major 



'scales, and was 39 pages.- All subscales were forced-choice requesti ng -that 1/3 , 
of the tptal items in each subscale be selected.; The -scales and subscales were 
as fol lows: . • . . 

Scale I: Organizational Structure , ^ 

Subsqafe A: "Organizational Characteristics 
"Subscale B: ' Social -Prof,essiona I Climate of the Organization 

Subscale C: * Descriptive Characteristics of the Faculty * • - 

Subscale D: Descriptive Characteristics of the Administration 

Scale II: Faculty, Department Chairperson and Dean (personal ity and leadership 

dynami cs) • > ^ , . - 

Subscale A: Personality, Leadership Styles and Concerns . of "Faculty 
Subscale B: Person.al i ty. Leadership Sty I es ^and^ Concerns of f^e Department 

Chairperson » v ^ , , ^ ' . 

Subscale C: Personality, Leadership Sj-V'^s and Concerns of. the Dean' ' ^ • 

•Soa-le III: Nature of Communications - 



Sutjscale' A 
Subscale B 
Subscale C 



General Nature of All Communications 

Frequency and Nature of Letters and Phone Call$* 

Frequency and Nature of Personal Visits ^ 



ERLC 



5cale IV: L^ve! c?f Usage 

Subscale A: Fi rst Stages of Adoption * ^ 

Subsca*le B: Predict! ohs of Later Stages of Adoption 
' • Subscale C:.- Organ! zations Mqmbers' Attitudes Towards Innovations 
Scale V: Studeints / , ^ 



*♦ \ 

\ 



Subscale ^ 
Subscale *B 
Subscale C 



Personality and Social Characteristics of Students 
Academic Style of Students 
Students' attitudes towards innovation 



J tern Analyses 

The first experimental, i nnovat ion- free f orm^ of the TSC for h^igher educa- * 
tional institutions was distributed to a small, nation-wide samp le'of 'chdnge 
agents who were asked to complete the TSC and to'critique and connment upon*, rt in' 
detail. In such a way, it was possible to obtain detailed responses from a re- 
presentative sample of -would-be users in 'addition to the data necessary for the 
item analysis, A synthesis of the critiques was compiled and remedi al .actions^ 
outlined. Altogether, thirty institutions wer^ rated and included in the follow- 
ing analyses. ' • . 

The firsd- type of analysis focused on 'the following qqestion: do items 3S- 

^ * . ^ • ' ' . . *• 

signed +o one^of the two groups of. items (ideal and unacceptable) belong with 

'their respective groups? This analysis was made on all items in a single an*a lysis 

J. * • '* 

and resulted in correlations between each item and t^e totaJ score fpr each group 
of items (idea/'and unacceptable.) The ajphas for the two, groups of Mtems vere 
as follows: items classified as idfeal = .99; and, 'items classifi'ed as, unaccejit- 
able = .97 (see table I ) . 

A second type of analysis focused on the fol lowi ng^question : do item^ i/hich 

are marginally classified belong'with their own group or with one o^^ the. twi ce- 

' ' * • / ' 

'malning groups (i.e.^ ideally cl assi f led' i terns or unafeceptably classified nems')l 
• • * 
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Table 1^ 



Each item "classi f ied as ideal , correlated with the total score' of items classi' 
fled a| ideal; each Item class'^fied as unacceptable correlated with the- total 
score of i-tems cl ass'i f i-e'd^ as unacceptable./ * * , ' 



Item Number.^* 



I tem cl assi fled as 
•ideal correjated with 
total' score -of items 
classl f fed as i dea^ 



, Item classified ^ unaccept- 
able 'correlated with total 

-score of items' class! fi.ed 
as unacceptable 



2- • 

3 

4 

5 

7 

8 

9 ' 



^ 12 
. • 13 
■ 14 

15 

I 

I 

rs 

/ 20. 
21 
22 

25 
26 
27 
29 
30 
31 
32 
' 33 
• 34 
35- 



.6987 
'.8395 
.7678 
.6835 



.6882 

.7574 
.6251 



.'6678 



.7061 



.7650 
.81-30 
,.7270 

.7432 



.716)1 
.5^89 
'.8591 



.5563 

.5763 
.71' [5 



' .5294 
.4516 

.4882 

.4873 
.6973 
» .8029 
.6676 



• .6626 

. .5Q2Z 
.6073 
.-5472 
.4427 



* This table includes information only on the final lOO'items selected. 

*» Item numbe-rs refer to numbers used-'in the second i n novation -free form of tfre 
higher educational TSC 'included In the appendix. _ • ' ' . 
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Table 1 (c5ntir1ue<i) 



Item Number ' Item class! fled . Items classified as unaccept- 

Ideal correlated with ' abje correlated with total 

^ * total score of items score of items classified 

classi f led as i deal I asHJOacceptab le 

% -. • 

\ --i i-. : 



1 r 







. 5Q95 




JO 


• 


. ,6497 . ' . 








6344 


- 9 


40 






^.5830 


A 1 






.4732 ^ 


AO 




5795 




A A 




5489 • ^ ^ 




* 




6046 




Afx ^ 


« 


7841 




4 / 














.6550 


AO 


« 


7037 




PU 


/ 


7326 










• .7386 


CO 


* 


7400 








6371 




f^A 




.6423 

5366 ' . ' 










P / 


- 


. 6 1 04^ 




58 ' 






.6345 


py 






.6608 ^ 


oU 




6099 






* 












.6537 






8947 




o4 


• 


* 7048 








. 8933 




66 ■ 


r 


.8947- 


• • 


67 


.7851 




68- ' 




.5567 • ' 




69, 




.6415 ; , 




70' 


• 




.5563 


71 


* 


. 7589 




72 • 






.5346 . 


73 




, .4496 • 




74 






• .5283 


75 


« 




■^•.6420 


76 




.8330 . . , ' 




77- 




.8108 . 




78 . 






■ : .6583 . 
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Tab le I Cconti nued) 



Item Number 



79 
80 
81 
82 
83 
85 
86 
87 
88 
89 
. 90 
92 
93 
94, 
95- 

97 

98 
99 
100 



Item class! fled as 
ideal corre lated with 
•total score of items 
classified as i dea-) 



' Item classified as unaccept- 
,able correlated with total 
score of itepis classified 
as unacceptab le - 



.7525 
.7821 



.6505 
.7882 



.6536 
.6783 

.63ia 
.8947 
.'606 1 

.5925 

..5976 



.6030 



.4571 
.7246 

/ 

.6208 
.5022 
.6987 
.7333 




.5500 
.4855 



P 



erJc ^ 



i ■ 
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A single correlational analysis was mede to answer, this question and resulted^^^ 
-In two correlations: a correlation between each marginal item and trte total 
score of unacceptab le j tems; and, a correlation between each marginal item and 
the total score of ideal items. Items which correlate<i highly with the total 
score for ideally classified items and which correlated low with the total score 
> for unacceptably classified items, were then considered in a later anatysis for^ 
assignipent to the I^deaPly classified item pool; items'which correlated highly ^ . 

with the total scorie for the unacceptably classified items and which correlated 

<? * > « 

low with the' total score for the ideally classified items, were then considered 

• • * ' 

in a later analysis for assig^ent to the unacceptably classified item pool. 

(See Table 2.) ^ • 

A third type of analysis focused on whether^or Jiot items were internal fy 

consistent within each of the five scales. Th^is analysis actually consisted of 

two separate analyses' (since each item w*as taken from one of two data p'ools, con- 

sisting of it^ms designated as ideal and items designated as unacceptable). These 
« 

analyses resulted in correlations between each*'^em and each of the total scale 
scores, (see Tajjle 3). Items >^ich correlated above .34 in these analyses were 
saved for the final j&nalysis described below. One of the results of these analyses 
was that the scales* jbemonstrated a lack of independence. I n otheY" words^ it can, 
\ be concluded that institutions which rate highly in one scale.are* I ikely to rate^ 
• highly in other. scales as we 1 1 . ^ , || * - " . • 

. The final type of anaiysis, like the third ^ lysis, focused on whether or 
not Items were internal ly *consi stent within each scale and within the entire in- 
strume(it. However, this analysis included only the items wl|yi.ch correlated above - 



.34 on the third analysis described above, and the marginal, items selected from 
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Correlations of^'i?ems. class! fled as margl nah with tofai scores of'^f^gm^.^ 
classi-fied as idpal and .total score^of iietns 'classivf i^^^-'^sjbnacc^ptable 



Item^Number^^ 



.Correlations with total 
score of items classified 




'hs .unacceptab le" 

'f . I.' 



Coiyelafions with tofal^'/ 
core* o¥ i te"ms c I ass i 
fied-as ideal' ■ 



I 

I 
I 
I 

. I 



I 
I 

I I 
t-l 
I 
I 



'> I 

. -1 



A. 6 
A. "20 

A. 26 

B. 7 
B. J-3 
B. 21 

B. 25. 

C. 12 
C' 23 

I. D. II 
J.D. 15 

D. 18 
0. 34 
A. 12 
A, 1-4 
A. tl9 
A.' 24 

I ; B. 17 
I . C. 3 ^ 
I 12 

i': A. 

' B.^g-V 
C. .7 
C. 15 
v.. B. 8 
V. C. 3 
V. C. 8 
v: C. 2^ 



- .568 
■ .463 

" .6,1-7'/ 

' leys' 
.52U 

■ .628 
:45S ' 
.531 
.675 
.678 
.435 
.464 • 
■ / .-643 
-.665 

.. .'41-9 
.590 

' ■ .588 
.470 
.513 

. .621 
.528 

. .641 
. , .531 
.400 
.446 
.424 



; -^.-568 
' ■ -■."446--- , 

-.708 ■ - 
\ -'.558 
• -.624 ' 
-.597/ 
-.519 
-.522 
, -.627 
::'.,-.535 
->S59 
" -7734":^;. 
.795-^" 
-.4&I.. 



-.487 
-.562 
-.4^4 

'-.440 
-.467 

' -.525 
-,5i24 
-^.513 
- .530 
-.545 



, f — "T" 

Information o'niy on Items 
ideal or unacceptab le for 



c 



*Thisr. table includes 
were reclassi f je<J as 



classified as marginal which 
the final analysis. 



**ltem numbers refer to the- first experimental form of the innovation- free TSC. 



Tab le 2 (cbnti nued) 



Correlations of i1;ems classified as marginal with tota'l scores^of items 
classified as ideal and total score o.f items classified as unacceptable. 



Item Number 



Correlations with total 
score of items .class i fied 
as unacceptable ' 



Correlations with .total 
score of items classi- 
fied as ideal 

_ \ : 



,.IV. C. 28 

•V. A. 10 

. V. B. I 

, V. B. 4 

V. B. 10 

V. -B. 12 
' V;" B.y 17 

V. B. 36 



.666 . 

.636 

.557 

.507 

.469 

.598 

.632 

.503 



-.628 
-.543 
-.59! 
-.535 
-.515 
- .-508 
-.688 
-.461 



II 



\ 

• » 



. /Table 3¥ 



. i :Each i'fem corre I ated. wi'th total scale scfcp?s.foT five Scales;. V • 

" , ' Litems classified as ui^iAccEPTABLE ' k' . 



1 tern Number** 



I 



■2 



» r 



4v 



I Cl 1 1. C 13): 

7 (III A 20)'; 

9 (II A 5) 

12 (V B 9) 

13 tl I I C '3) 
15 (■II A 36> 

17 (V B 15) 

18 (IV A 19) 

19 (III C'2) 

20 (1 D 5) 

26 (II C 8^),^ 

29 CIV (y29) 

/30'' ('11 1 ^n) 

.31 (i C-5) 
32 (M B 32) 

40 (I e II) 

41 (II C 5)' ■ 
48 (I l/B 29) 
51 (y'''B'3) 

58 ;e.i.n'A 2); 

59'C'I iVb ^3); 
.■i6|;'('!l A 25jy 
''70. (1 1 .A 37P 



/ 



/ 



/ 



.474 

.55j 

.689 

.863 
-.325 
' .375^^ 

.'366' 

.65^ 

.716 / 

.796 ■•'/ 

.565 . 

.397' 

.534 / 

.626' ' 
/'. 529 
' ..524 

.397- 
^542.:>.;- 



./:.62i' 

.-.656 /' 

. .,764- 
...772. 
.'.439 
/ .368. 
/ ■;^*.332 
; .634/ 
.729 
.758 
.682 



.•■.543 /•■■ 

■;.5"63;.-.-/- 

/ .498/v' :"■ 
.^.^52.;'''; 



^$63 
i799y 
;'445- 
.667 , 



.6p^ 
'•;532 V 
:4?5 
.600. 

.60^\ - 



.•564V.-- 



.644/V'-^N:-..V.754 ^\ 

.553 ■>> Vv^ ''>60.O , ■ 

yf699 'r'y^- \. _ ..684^\ 

j:vv.47V:!^<r ■:-K,62'\ 



■: xv-;:3'8'.l'/-. 

.6-7^^ 

^ .622 
■/\.'7-30 



/. ' \'i6^/(il A 25jy ^'>;.699;-r - \. '..684V ; .330 
• ■ . •\/70-'(ll .A 370 p/;.47V:l|r .;-K.62l • • / .543 
■'. " • . .- . ji;-(f\ I t ,^/.?-.-47;2 s:\24--. , ■.. .485 

'/ ; "/'7 .-•'ji(-|-c-3)-; •'r".feoi6;r>!V>vX^. * N ■■^232' 
-'^"•■"/i' /'■' imcu.v c 2h ; ^^■;4^!4•^':^'•^t■^''■^.■~.i?<K^^v^ 

■'^ • ' V ;/ ■ '75 ■ ( I G32l) Xn:573'x^.^..V730 



78' (I l, B 21) 

7I (iv'b i|2):j 



' .'597>l . , , 



- ff 



iz i \ I A '^2) f [■ i'4^^ j .) ^\'\45? 

b/(in',c:-26i i .Jpi.jr'-r: ''PP> 

W ( tp.-B M) t ! ti567:' I ' ; r V .-666 



- '■ ^584 
459 



.8(3^3^ • 
.629\ 





, .f) lia f' ' I O.b i tema^^&lecte d . 
s^dOD.d experimental V form of the 
afpnii^BsH^'iehr to numbers used in the 
i TSC. ■ 



V 



r-''.la^;le.3'-^C<:bntinued) ' ( 



Each item cor re Late d With total scp I e scores for fl'Ve scales. 

^' . . " ITEMS. CLASSIFIED "as IDEAL 
Item Number • I ' ,^ '^'^ H ■ 5 4 



■ 2 (V B -18) 


% •.705,"/. ' , 




- •.4 lj5^ 


'.633 


.;'.753 


,. . 3 (|-r*A 26) : 


' • '!S69 ■■ 1 

'v. ' ' 


; ; ,;78i. . 


.475 • 


,853, - 


..678 


4 ( 1 C 4)^ 


W ~ 

.:• ;&37 • ' 


,64o' 


.-.409'j,-.^;\- 


■ '.782 


.677 


* . , '. 5(1 D 8) , 


'/7'5^ .. 


..693';"' 




' ' . 580 


^ ..463 


.;. .« - • 8 (V e 34) . 


' ' .'670 , ./ ' 


'^^,13/ 


/. ..466 " " . 


.663 


.738 


,10 (V B 5)' 


' /.639.,-. '. 


' .643 V 


.65r 


.681 


, 767 


II ( U 1 C II) 


.468:. 


'/ /e.l8 A 


.'750. 


.533 


,433 


'. J4 (J ,C 18) 


.689. ..; 


/ ^ . -,/ 
/ .5 -13^ 


.480 • 


.667 


.593 


.16 { IV^B 9) • 


, .720" ' 


.'646, ' 


.457 


. .791 


^. .479 


21 (1 D 14^ 


.806 , ^ 


■^801 


. .'.488 


, ,675 


,525 


■ 22 ( II A -28) ■ 


. .780 


\ .806 


/ '.•565 


,752 


,651 


25- (IV A 21)' 


- .712 


' . 56 1 


; ; 'r-SOS 


• .717 


.725 


' •■ 27 (IV A 9) ■ . 


/..783 


'.. ..6L2- 


. .370 


.862 . 


• ,632 


33(ii:;A^;,^,--. 




. : .703- 


* ..457 


.654 


.670 


- 34 (UD-12J;-^ 


■ ^ ;-606 V 


-.616 


- ..257 . * 


. .505 


^ , 354 


35 (J^ A :23-)": 




' .844 - 


.542 


.842 


.663 


.-36 (l.;f;l'=Ar-5^; , 




, .591 "v.. 


,868 


.^61 


,322 


; ' 38 (y'\A 1^) -v; 


.623 ■ 


!50l . 


.439 


^ /620' 


.696 


• • 39 (1 A I4,)'0--: 


- ' . , .596' • 


..600 


-.507 


.592 . 


.494 


. -.42 (V A-.5)' 


■, ' .4j59 ,• 


. .460 


.385 




.725* 


' '44 aji^B 21) 


.429 


.501 


.761 


. 374- , 




'•■\''A5 (r.'i.i6) 


■ •■-.580 


.520 


.367, , 


.711 ' 


.498 


.t .'46. ( IV- B- 10) 


'764 . 


.661 


.464 


.826 


.744 


47 (1. D 19).' 


.72.2. 


.629 


.235 . 


'.612 


.515 


'\;,V- .■V9.(i'i B 5)' 


.651 ^. 


.723 


.493 


.698 


.517 


-, ;'50^ (iV B 1) 


.692 » 


.572 


.j604 


.810 


.58/ 


■' 52 .'JV B 7) 


.^60* ■ • 


.648 


" .727 


.638 


.612 


, '53 ;(l II A-21 ). 


.536 


. .534 


.744 ■ 


■ .479 ■ 


.556 


■' "• ,54.1U l/B II ) 
3§v(V A J9l 


.644 • 


- .699 


.475 - 


.593 


. .369 


' >477 - 


.423 


.296 


.474 


.715 


.' 57 (V A 7) ' 


. ^539 ■ 


. .542 , 


" .348 


.572 


.761 


, , 60 (1 1, A 16) 
,61 (ll'r A'-12) 


.538 , 


.615 


, .412 


.493 


.618 


..352^ 


.555. 


• ".745.^ - 


. .428 


.519 


?63 (I V 0 I'ST 


" .902 . 


.795 - 


.537 


' .935 


• .753 


i 64 (1 .D:7) 


.666 


.778 < 


' .5I& ; f 


.615 


.485 


" 65 n'v C 7.) 


-.881 


.836 


• .584 


. .-903 


' .710 



Table- 3 (continued) 

j , 

^ ' ITEMS CLASSIFIED AS IDEAL 
Item Number \ - . ( ' ' 2 * 3 4 '5 



d6 (IV C 4)> 
67 (1 1 I A 26) ' 


.902 


.795 


.537 


. .935 


• -753 , 


.695 ' 


•••735 


.777 


.675 


>. 593 


*6l (V A 22f \ 


.,494 


.395. " 


.306 


.^24 


.770 


69 (V B 38) •. 


1594 , 


\ 


- .480 


.616 


.677 


7i (IV C 19)- , 


.769 


.576 


.496 


.877 


.643 


76 (Tv C 16) •* 


■ ..8.12 ~ 


..741 


.649 


.,809 


.654 


/77 (IV A 10) 


■ .76^9 


':" .661 


.602 


• .800 ■ 


■■" " ;'759 


80, (V.B 23) 


.719 


•.6;5I_ 


.475 


^ .702 


.755 


■ 81 (IV C.I4) 


.835 


• ' .690' 


.371 


.827 


.681" 


85 (III 'C.I2) 


.502 


.586 


.810 


-.523 ' 


.502 


86 /V B 14)- ' 


.730 


\J5 1_' ■ 


.4*83, 


.786 


.716 " 


92 (III C 27) • ' 


. .470 


.6"64\ ^ 


.858 


.498 


.44] 


93 (1 1 1 C 23) 


:-534 .. 


.586' , "^"^ 


^-.858 


.606 


• /■ .472 


94 (vIV A 5) 


^82 


..p28 


.305 


.723 ., 


• X .540 


. 95 (I'V C tW , • 


.902 


,/.795 "'' 


.537 


.935 ■ 


• .753 


96 .(V B 24)' 


.604 


/. .470 


.252 


, .576 


..765 


98 (V C 15) 


.463 


/• \.4g6 


'.363 


.534 


.799 ' 


100 (V-C 3) 


. . 504 < 


'.509 


.389 


.507 


.750 



_ . ^ — : : ar 



/ 




I * 



M-he second analysis, also described above • /ij^LS^ana I y-s is actually consisted of 
^two separate analyses (since'each item was taken from one of two data pools con- 
sisting'pf items designated as ideal and iteros des'ign'ated as unacceptable). These ^ 
analyses resulted in cQrr^lations o,f each item.-with the total score of. the in- 
strument a'nd with its total scale score (see tab|e'4)._ The alphas of the five' . 
. scales for J^'i deal ly classified items areN^ follows: scale I = .96; scale 2 = ^ 
.96- scale 3 = .95: scale 4 = .96; scale' 5 = .95; and total alphas of the five 
scales for the unacceptably classified items are as follows: scale I = .95; 
scale 2 = .94; scale 3'i='-.94; scale 4 = .92; .scale 5 = .89; and total alpha = .98. 

I tern Selection . . 

After the sampling was comp'leted it wds .deci dedthat the Ideal length of the 
instrument st^ould be lOO 'iffem^, and that the forced-choi ce format should b^ changed 
to a five-point Likert-type s'cafing. Consequently/.a I 1' margi nal items were re- 
moved except those which correlated highly in the final- analysis" after having been 
re-classi f led as ideal' or una.cceptab^ . -The 100 items whi'ch 4:iad the highest. over- 
all correlations for a) I of tb^^n^lyses we're,, then, selected from the remaining . 
item^. Finally., these, hi ghest correlating items were examine,d in terms of :the 
detal led comments made -by cjianger bgea*s who had ccnipleted the checklist. Some 
Items were then rewritten for greater clarity. ^ 



Dile -t^ the fact that 'the !sca I i ng has now been changed from f orced-chpi ce to 
Jt . . . .1^ ' _ . ■ : ■ - ■ • , - - 

Li^ rt-type^ ani, because some of the finally selected items h.ave^be&n rewritten, 

asQConci, and f=inaK, items analysis Is planned. However, a' second Item analysis 

^probably will rtot rosult in any greaj. afto-ration of the present instrument, -since 
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Table 4* 



EachUtem correla+ed with total score of ins+rument and total scale score. 



Item Number** 



ITEMS CLASSIFIED AS UNACCEPTABLE 

Correl^ation with total 

score 'of instrument 



Corre lati on w 
scale score 



ith total 



i 



1 (11 1 C 13) 




.8073 


ft 1 
. O 1 


6 (i B'I3), 


i 


.6774 




7 (III A 20) • ' . 




.7229 ^ 




'9 (II A 5) 




;109o 




12 (V B 9) 




■ *7 TOT 

.7327 


RQft7 


13 (li i C 3) ^ 




.7688 




15 (11 A 36) 




.6608 


\' . 0 / -)U 


17 (V B 15) 




.5427 


. OOO / 


18 (IV A 19) 




. .7202 




I9-(II 1 C 2) - 




' .6606 




20 (ID 5) 




. .5668 




24'(IV C 8) 




.6911 




26 (fl C 8) 




.655 1 




28 ( 1 A 6) 




.6725 


7Q 7 1 


.29 .(IV C 2i) 




.6653 


. /U-)0 


50 (1 1 1 A 7) 




.5210 


oou / 


31 (1 C 5)- 




..6758" 


79 Q 9' 


32 (1 1 B 32) 




.5864 


7 "=^99 
. I DLL 


'37 (IV C 28) 




.5310 




40'' ( 1 B 1 1 ) , » 




.6379 


.0 1 uu 


41 (tl\C 5)' 




• .6298^' 


ftc;7 1 

^ . o;? / 1 


43 (V B 36) 




.5830 


. IKJDL 


48 (M-^129)' 






.6438 


. 51 (V*^"-3) 




. 5925 


.7527 


56, (1 .C 2'3> 




'• . • .5875 ■/ 


.6292 


58 (III A 2) ^ 




.6059 / , 


.6120 


59 (III B 13) 




.5823 


, .7396 


62 ( 1 1 A 25) 




.5777, 


.6069 . 


70 .(MA 37) 




.7039' 


.7322 


"72 t\ 1 C 27) 




.626^ 


.6821 


73 (1 C 3) 1 




• .6845 < 


. , .7438 


74 (IVC 27) 




.6310 ' • 


.6876 


. 75 (1 C 32) ' . 




. ^5747 „^ * 


.6584 


• 78 (1 I B 21) 




~ .6037 . • 


.6729 


. 79 (IV B 12)'.' . 




. .5904 ' ■ ■ 


.6110 


82 (II A 42) 




, .7430 


.6570 



■7 ■ 



*This' tabVe includes' information only on ttie finaj ^iOO. items' se 
**ltem numbers' refer 'to numbeVs -.used iq the second experimental 
' td ucaj^al TSC. Numbers in parenthesis refer/to numbers used" 
ERJC nt-al 'form of the higher-educational, TSC^v/ ' ' q ' 



iected. 
fom of 
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the.higher- 
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Table 4 (continued^ 



Each item correlated with total score of instrument and total scale sco^e. 

\ , ' ' -ITEMS CLASSIFIED AS UNACCEPTABLE^ 
\ • " (continued) 



Item Number 



Correlation with total 
score of instrument 



Correlation vt\*fH total 
sea le .score 



83 (1 1 1 C 26) ^ 


.6298 


84 (III C 15) . ■ 


.7181 " 


87 (II 8 14) 


.7297 


88 (11 1 B 7> 


.6^20 


89 (1 A ,5) ' • - 


.7094 


90 (III AM 7) 


.8343 


91 (1 D il) 


.5906 


97- (V B 37) 


.5014 


99 (II A 22) 


.6466 



.7470 
.7968 
:7975 
.7399 
.7328 
.8699 
.6863 
.6958 
.6125 



ITEMS 'CLASSIFIED AS IDEAL 



1 tehi Number. "- 


Cor re 1 at i on w i th 'tot a 1 


. Correlation .with total 




score of instrument 


"scale score 


2 "(V B 18) 


■ " . -.6939 


■ .7619 


3 (1 1 A 26) : 


.8569 " ' 


.^435^ . . 


4 (1 C 4). • ' • . 


'..6507' '. 


.\ ,.7128 


5 (1 D 8) 


.7045 * • . 


.67 r2 ? 0^ 

^- ; .7384^ ^* 


, 8. (V B 34) 


.6872 


10 (V B 5) . ^ ' 


.7500 


' .7732 


II (II 1 C, 1 1) 


'^.6355 '. 


\ .7526" ■ , 


14 (1 C 18) • 


\'7024 


\ .7856 , * 


16. Civ b 9) ■ 


.7144 


\ .7906 


■ 21 (1 D 14) 


.8256 . ' 


\ .8515 . 


22*(ll A-28) 


; .8464 


.7964 


23(1 A 26) . > 


.7579 , 


.7724 . 


...25'' (-IV A 21 ) 


.7280 ■ ' 


' ' i7J67 v: ' 


'■'27 (IV A 9) > 


.7441 


.8618 ~ • 


33 (It A 9) 


\. . .7167 


.7091 


•34 (1 D 12) 


\ ■ .61'^ 


.7457 


• ■. 35 (M A 23) . 


1 -•7965 


.7640 


36 (III A 5) 


V ".5990 


.8715 


- 38 (V A 16) 


.6409 


.6936 


39 (1 A '14) 


.6370 


.6129 


42 (V A 5) . 


.5773 


, .7184 
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Eac^i Item correlated 



Item Number 



Tab le 4 ^(continued) 

/ 

line 



with total score-of instrument and total scale score. 



JTEMS CLASSIFIED AS IDEAL 

Corre latioh^wj th total 
score o/f instrument 



Correlation with total''' 
scale sdore 



44 ( 1 1 1 B 2 1 ) 


< 

< 




/ .542'9- 


45 (1 A *I6) * 






/ .6194. 


46 (IV B 10) • * 






. / .7845" 


47 (1 D 19) 






/ 'W^ 


49 ( 1 1 B 5) 




• 


/ -.-778? 


50 ( B 1 ) 






/ --.■7/311 


'5? (V B 7) 






./ ..7349 


55 (III A 2 1 ) 






<- / " -r^'^ ' 


54 ( 1 1 B 1 1 ) 








55 (V A 19) 






. / ^ 15290 


57 (V A 7) 






/ U\Q\ 


60 fVl A 16) * 

\J\J \ \ \ f \ 1 w / 






, ■ /.6072 


6! ( 1 1 1 A 12) ' 






/ ^.5711 


63 (IV 'C 15) 






/ .8957 


64 (1 0 7) 




0 


/ .7992 


65 ( I V C 7") 






/ ^ .8947 


66* ( 1 V C 4) 






.8957 


67 ( N i A 26) 






'.7801. 


68 (V A'22) 


* 




.5502 


69 '(V B 38) 






.6322 • 


71 (IV C 19) 






.7563 


■76 (IV C 16)' . 






.8279 


77 (IV A 10) 






.8065 


80 (V B 23) 






.7505 


81 (IV C 14) 






.7789 


85 (III C 12) 






.6528 


86 (V B 'l4) 




% 


.7906 


.92 -(I II C 27) 


i. 




.6543 


93 (1 II C 23) 






.6805. 


94 ( IV A 5) , 




\ 


.6338' 


95- (IV C 10) 






.8957 


'96 (V B 24) 






V6077 


98 (V C 15) 






.5871 


100 (V C 3) 






.5955 

1 . V 



1 



.7654 

.6166 
^'.8256 

.8217 

.8074 
* .8099 

.6061 

-.15 1 9 

.7238 

.7159 =• 

.705.3 , 
' .6152 
- .7449 

.9347 

.8317 

.9025 

.91AT 

.7815 

.7696 

.6698 

.8768 

.8091. ,• 

.8000 

.75.19 

.8272 
.,.8089. 

.7233 

.8574 

.8574 

.7231 . 

.9347 

.7684 , 

/7932 - 

.7515 
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the item correlations were reasonably high* Therefore, *the se.cond Itfem analysts 
will be more precautfonary than exploratory in nature*^ 



:Descrrption of -Instrument * , * . 

^ . ' '"^ i 

Since the i nstryment .has. been^ limited to '100 item^ in a Li kert- format, the 

• '■ . ,. / :'' - •• 

marginal items and all 16 subscales have been eHminated. The insjt-rument now 

consists of '100 randomized items which'can be broken. into 5.di^stinct scales con- 

taining twenty items 'each. Some of the-scale naTOS have been mbdified f*or greater 



clarity and are now as ff^riows: , . - 



ERIC 



Scale I: Organ i'zationpl Climate . . ^ = " ^ 

(Items in Sc^le I attempt fo tap information about the organizational 
climate by focusing in such variables as: the power" system within 
the organ izjti.on; the kinds of beh^^vhors that are rei nforced; organiza- 
tional val uJs and norms; 'arrd-.^openness" of the" qrgahi zation. ) 

Scale II: Organi zati orfa I Staff - ; • i ^ ■. ■ 

(Items fn S^ale II describe persona-lity and . leadership characteristics 
' of faculty |nd adniinistrators related to the siic'cessf u I < adop.ti on of - 
innovations! Items focus an interaction between faculty noembers/ be- 
tween admiTilstrators, and between 'facu I ty and ^dm1 ni strator^ , l.n add i - 
tion, irtemsiseek to- identify attitudes and^^terestSi of the. ' facul ty ,;' 
and admi rtisf-ration as they are re'l ated to , i nn6yation .) 

Scale III: Communi cation '' • ■,. v '' 

(Items in S^ale I H are related to the communication process associated . 
with successful adoption and In^pMementati on oh innovations. The items 
probe the cfegree towliich informatipn exchange -i s^ superf'i ci a I , restrict- 
ed, or procjucti.ve. Items also attempt 'to tap thexjuality of communica- 
tion between change agents (both internal andB<ternal^ and ^the .staff 
of the -ins-litut'ion.) ' '• i 

Scale IV: - I nnovati ve ^Experience ^ ■ ^ ■ . ' • 

(Items in Scale IV describe the expe^rience pnd degree of soph.i sti cati on 
. . that an institution K'as had with the, ado^tf^n and implementation of * • 
innovation^. Items attempt to identify degrees of awareness of basic ^ 
infonnatiorf about innovations, amd indications by faculty members that 
they hav^e |ome idea how to integrate an ■ innovation into tb.ei r- teacM ng . ) 

Scale V: Students \- ^ ' ': 

(Items in Scale V attemot to measure characteristics of students which .- 
'can a'f feet the adoption-implementation- process\- I n measuri ng these 
characteristics of students' attitudes towarjds the faculty, andtheir 
course work are considered to be cruc4a-i, -as well,, as student enthusiasm,, 
stude^'t interaction with pe^rs and- faculty, and stucfeht. i ndi vi dua I ity - 
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Scoriag of the Instrument v • ' * T 

■Detailed i nstrucj-ions for scoring the instrument are inclAided. with tfie 

• instrumen't in Appendix A. ^ In brief, a reverse key is% given for unacceptably - 

class^fi-ed items, and five keys ^a re given Jisti^ng the randomized numbers fpr each ^ 

of the five separate scqles. Ther^ are a total of six scores derivable from 
t ' ; . ^ ' . . • ' 

.the I'nstrument, five scale scores and a total scof-e. 

Future 'Plans for the Higher EducationaJ- Based TSC , ^ 

% t- J ^ ■ 3 — . ' 

) ' • * 

Before the second item analysis is conducted, the higher educational based 

' ^ > ) • « 

' -TSe will be given to organizational development spetialists in order to obtain 

• suggestions' for modification of individual itSms. After the instrument has been 

' ^ ' . ^ /\ ' ^ ' 

scrutinized in this mannar, it wi H be submitted to a sample Of change agents, 

- ^ • - \ 

and a minimum of. .thirty i nsti tuti ons\ wi I I be rated.^ The types of item analyses 
used\ill be identical to those used in the first analyses. ■• ^ 

Initial Norming'and Validation ^ ^ ^ ' 

* A minimum of .ten- external change agents will be contacted and asked to- 
subjectively select fi f-fy-two' institutions: 25% (13) of which' are ideally suited 

i 

'to successfully adopt an innovation; 50^ (26) of which are marginally sui.ted; and, 
25? (13). of which are unacceptable. This distribution should increase the chances 
that a fu I Uan a" representative range of scores are obtained. After these fifty-two 
Institutions have been identified, an internal change agent and faculty member 
'f OP each institution will be selected and asked to rate their institution by .using 
the fSC. Score ranges of theirxTSC ratings wi 1.1 , of course, th^n be used to deter- 
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mine norms for the scale scores' and total score. . ^ 

, '* ' • • f » ° - , - • 

A ^validity coeffijcient wilt be determined by correl^ing the fiVst group' . 
o} external change agents' subjective ratings with the second group of internal 
change agent and faculty ratings/* Hov/ever, before this, validity coefficient 
. is computed, a ^:omparison will be made, between the ratings of. the internal cffange 
agent group (who may have higher status due to the fact that they are in a 
position to brihg about change) and the faculty group/ This comparison^wi I I be 
made /to -check for the contaminating affects of ^higher status TSC respondent^ 
giving more favorable ratings for the^i r institution. 'H these two groups do 
differ s-i gni f icantly , two separate coefficients wi N be recorded* . . ?^ 

. ■ ( ' ■ ' 

The Innovation - Free Form of the TSC 

For School-Based Settings ' \ 

The items for the school-based T^C w^re collected from two sources: an 
extensive literature search for information describing innovative and non-inno- , 
vative schools; and, interviews with ten practicing schdol-based change^ agents , 
The information collected from the literature search was organized in the form 
of a series of referenced paragraphs summari zKng- study findings. Items were 
in turn written using these paragraphs .as an information base (see Appendix B 
for the reference list resulting fi*om the literature search), , 

In taped interviews with school -based change agents (see Appendix C for the 
interviewing form), the change agents were asked questions about the school and 
school district environment.. The speclfiq questions generally corresponded with 
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the major areas, which emerged from the literature,. The tapes were then partially 

transcribed for information, whi.ch would be. likely to yield i terns ,^ and items were ~ 

> . • " . ' " ' ' ' • i 

■ ' subsequently "written. Based on these interviews and the literature search, an 

' item pool- «f .500^ descriptive statements has been collected to date. and fall .into ^ 

"the following seven scale areas: < * ^ . 

'"Scale I: ' School-Based Staff . . ^ , ' ■ 

. ' - (Items in thr^ scales-describe, character i sties of school-based staff - 

' in relation to the school's potentiaJ for successfully adopting Inno- . 
.vations. The items tap informatiqrt on personal ity,\nd leadership 
. • styles of teachers, principals, and- counsel orfe, in relation to School 

innovativeness.' Variables sucj) as interpersonal and profess.ional^, 
' interaction patterns, staff attit(!ldes» previous working experience, 
and demographic characteristics are al-so considered In this- scale.) 

Sea I e M : • . C ommunications < • ' . , . . u ' 

'f .'(Items in this^scaj-e attempt "tb identi fy^communi cation variables which 

' significantly iffect a schc3ol's potent! a I . for^uccessf uj ly adopting 
an innovation, fiis scale- particularly aims at uncovering i nforirj^tion 
on.qatterns of communication both within the school ana^-tt^-e entiqe . 
school 'system. . Particular items focu^on the Initid^ors, types, 
' *' and forms 6t corrmuni cation with respect to both formal and informal 
channels of communication.)^ , - ^■ 

Scale III: I nnovative Experience ' ■ r> 

(Items in this scale describe a school's experience with innovations 
. and-attitudes towards^M nnovatipn . Items in tKi s scale are -concerned 

with both past attempts at innovation and present plans for innovation. 
P^^rticular focus is- on the degree to which a sch-ool has prepared itself 
foF the adoption of innovations, the reasons for considering adoptipn 
J ■ - of innovations, and the extent to which the $choo-| has realistically 

assessed its needs. The ponsultant role, the district role, and the 
community role are also considered in relation toJ)oth past and^resent 
p,lans for adopting i nriovations . ) ■ . " 

ScSle IV: " Central Administration u * 4.u 

(The Central Administration Scale focuses on relations between the . 
• ' central offrces,, school', and school board, and i denti f ies^ atti tudes 

of thi central of f i.ces^and school board toward innovation', their ^ 
. rpleJin relation, to the school, and their, -awareness of the school's 
^ ■ .partfcular problems.) , , ^ 
Scale V: Sch ool /Cqmmun ity Relations ' , " , ' 

- ■ "(Items iAthe School /Community Relations Scale attempt to tap informa- 

tion on siteh variables as the -amount and sources of funding, the degree 
of interes\and involvement of community groups in the scfioo I, system, • 
the soc1pl-&nomic envit^onmegt, and-attitudes of the cornmunlty. toward? 

the school;.) \ c r , 

\ , . ■ 
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Scale VI 



Scale VI I 



OrganTzatiO'hal CI imate • ^ 

, (Items in this scale descri'be the worls climate end organi zational > / 
structure of ♦both' the school and the central district office. Some 
of the particular organizati'onal variables which are tapped include: 
how decisiOTs -ar^'made; how gpals are' established; what task groups 
exist; how task groups function; how planning takes place; what 
resources are avaialble; how resources are used.; how the organizational 

•hierarchy is' defined both within the school and the school district; 
and, the* <legree- of centra li zarl" ion wi'thin the school .dl stri ct J ' 
Students ' ' * . ' • . 

(Items in this scale describe student behavior, attitudes and demo- ^" 
graphic characteristics, . Items attempt to- tap information on student 
attitudes by focusing on student behaviors in the classroom and the 
lunchroom, as well as particular behaviors such as absenteeism, tardi- 
ness', .and number of discipline problems. Minority relations among 
the students, teacher/student rapport, and academic excellence are 
also considered to be 'important vSViables affecting the adoption/ 
diffusion process, 'v. . 



< ) 



Item Ana lyses and Initial Validation and' Normi ng/ ' 
' >200 of' -^e^nitiaUy .col1ected'^5SOl5'']^^ will be sajected to build the 

eXDerimehtal form for the item analyses. However, before these items are. sub- 

' • ■ ■ ■ - 

' mitted.to d*fs§mp1e of change agents for the analyses, they will be given to a 
'grqup of organizational speciajists to be examined in the same manner as the ^ 
Items on the higher educational based JSC, 'The items, formatting, J nstructions, 

A ■ ■ 



and scoring.;^t^firwTTrbe i de^^^ to those o^' i-he higher educ^atlonal based T5C, 



Similarly, ;Hie plans to dat^on^the initial norming*and validation will be the 
same as the pf^ans for the higher educationir based TSC (see Append i^D for b'' 
sampllng.of'the schooljbased TSC'items). 
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Appendix A 

The "Trouble Shooting" Checklist (TSC) 
' ' for Higher Educational Based Settings 

(Experimental Form No, 2) * ' 

Please rate on a I - 5 scale (as indicated below), how closely each I tem, descri bes^ 
the department you a^ rating: ^ 

5 = very typical 
4 = somewhat typical 
^ ' 3 = neither typical nor untypical ^ 

' '"^^ • 2 = somewhat untypical 

^ . . * I = very untypical > 

L Any contacts with change agents that this departrrfent requests will be at the ^ 
wrong time and/pr for the wronp reasons. » , 

2. The students are jn frequent contact with one another <e. g., In seminars^,^ , 
' in the field, in the learning resource center). \. 



3. The faculty are concerned with Increased understandi-ng of both themselves . v^ 
and others.-^ * r . • • . \\\ 



he faculty seem to be weTl Informed about current educational de\^e jopmentsy^^^^^^^ " 
n many * f ie I ds .\ , ^;>-.r '"^'^^ - ^ 



4. The 

many 

5. The department chairperson has support' from admt ni strators\b>3hja^^^ 

. the organizational hierarchy. ^ "^^v:^^ -"^ -^V-* ' 

6. ^Individual members of the department are not In a posltlonf tq:>e'fK^^^ ' ,><:-:r'^.^^' 



.6ach other. ^ ^ ^ ' 



7. There is little real, substantial .coffimutYi cation (e. g., evasl)(6 connmun1>;;;Jj<r' 

.Slons may include remarks about the financial situation/ phi I osophi^^O^i^^ - ' T fr.'. 
- Uases, what is going to be done, etc.). ^ •..'<•,•.•.'■.' \ • Tli^V 

>8. 'The,_^j^e>.ts are enthuslastlcal ly Involved in the program., . :I'>' C^^^ ^ 



_.. ..... 

10. students' Ideas' are taken seriously by the faculty. 



9, The faculty canndt imagine either thi^nisejves or others in-new roles. 



..-V 



11. Frequent contacts have resulted in an Increased rapport be+v/een change agents 
and the department. ' ^ * ' 

12. The /students do not respect faculty opinion. 



13. Th*e department has not responded to the on6^or two contacts that have be^n 

made by a change ,agenf . , ^ ^ 
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wP.tfesse rate bn -a I* - 5 scale "(a^ indi catfed be"low>r-h6w close ly each Item describes 

, d^.J u/,.^ , , « , ?• » » » #^ 

-v*^ ' m / ^ • 1.^ ' ' ^ ' ' -^'v ' * . ^ - 

/'•' ^ .V*^ ' *4 I . '5 = very'typical y / ' , 

' ,/'•• "J^} ' . i 1' . . 4 T- somewhat typical' ^ ' - 

. ' z'S" i'"'*'^ ' ; 3 ."pel tbe^'r typical nor untypical 



^ , i \ / 2:f somewha*t untypJcah 



'•; ' H I •"•/.very untypical 

14\fThe 'faculty are nef'Jecti ve^arrd .anal yt lea 1 about the adopt! on- Imp lenientat ion 
t, ^^' process. t ^ 



'-'^ *^I5. The faculty are.;in^tf ferenf>o the interpersonal dynamics withiO/their department. 

^6. This departntent u^es resounce material effectively to develop its own mateT'als. 

17. ^Xhe-stLK^nts view the! r. education only as a m^ans to an end/ 
^ ^ 7l3vi. /department has minimal awareness about rnnovi|ttipn. 



2\. The administration is: flexib le.* / - . y.-V., ^. 

22. The faculty are interested in teaching students. ^ ^^"r, 

23. The structure of the organization includes reasonably we [-1^ function * ■ \^ c^qnica- 
tion channels. . * * • ' • 

24. There are onjy a few faculty'who are trying to arouse interest in actuai trfi'l 
testing of an innovatiphl * ^ 



■ ' • , ' ■■ ■ . • I-- •\- 

25. The departmeirt' is, involved wfth the successful adoption of other innovations^^,;,- 

:i26. The 'dearr-acts. as a hrWran-^e to adoption and dj-.f fusion of innovation. </:>' 

•27.. This/ -departmerit- lips al ready. ,;^^,a Iked ^bout>odi fyJng 'testi ng materials to -fit their 
. needs for pi lot testing. . \ \ 

• ■ '■ :[ " •■ . , \ •■ - 

28i. The chgnge gg'ont wori<irlg af thls^departm^ntMs not In a position of authority. 
-29. The:facu,lty/ire threatened by new approaches^ . 



E^-;'f;-:i. : ■ , .'■29 



item describes 



4^ 



Please rat^ on a I - 5 scale (as indicated below), how closely'eaci 
the department you are- rating: * 

, 5 very typical « 
;^ ' 4 = somewhat typical 
\ . 3 =? neither typical nor untypical 

2 = somewhat untypical 
. * . I = Very wntypic^l 

30* Contnuni cations between a change agent and this department ar^ primarj^ly social, 
rather than professional-. " 

31. Jhe faculty make much noise about "standards." ^ 

32. The depar^m^nt has no' recognl zed leadership. , ^ . 

33. The .faculty exchange ideas with one another. 

34. The dean supports the facuTty L adopting innovation?, 

35. There is a willingness to initiate needed change rather tjian maintai'n the 
.status quo. 



.s__,. 



36. This 'department feels comfortable'wlth»regul&r communi cation from th'e beginning 



of the adoption prpcess. 



37. Many of the fa.cul+y, whi Ifi.riot acftlvely opposed to .1 nnov^tion, will not cynmit 
themselves... 

^38. The students takej^i tiati ve in seeking out challenge, 

' 39. There iSN^small group of liighly involved adopters who^ork in close proximity. 
40..Thdr^js an o^rganizatloijAl ine.rtia at this institution 
A I . The dean, not-assert-l ye* -I n -es+ab l-Uh4-ng:-aad/-or_at_ta/ n.l ng. goa I s^^ 
42. The studeYits have a"^high energy level. 

: \ 

43^ The students, are pass lye. 



44. CocnmuAi cations- result fti constructive action. 

* ■ ' \ ' ' ■ 

45. There Is a small group 6'f adopters who clearly demonstrat^-^Ti' ^'BTl Ity tQ effec- 
tively communicate with a larger faculty group in order to gain their support; 
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Please rate on ^1 - 5 scale (as Indi cated below)-, how closely each I terfT describes 
the department you are rating: * 



5 = very typical , , ^. 

4 = somewhat typical 
3 = neither typical no^r untypi cal 
2 = somewhat untypical 
I s= very untypical 



ACAn innovation already adopted by this department shows promise of being a cataly- 
tic force behind the adoption of future irvnovatiofis. 

4 

47. The department chairperson is strongly support?V(e.g. , through public statements 
promotion rewards, provision of resources, etc.). " . 

48. The department chairperson uses many 6liches (e.g.,' why change for the sake of 
change?" ^ before we buy any program, we must establish a^ sound philosophical 

base, etc.") . ' . i 

49. The department chairperson is concerned with current .developments relevant. to an 
^ InnQvatlon uoder consideration for adoption. 

50. This department characteristically discusses pl&ns for research and refinement 
when considering any :i nnovation. 

51. The students quite often succeed in spite of the institutional influj^nce. 

52. The students praise their program for the i nterrelatedness of its courses.- 

53. TKis.depa,r:»7nent shares their problems and experiences with a ch.ange agent. 

. 54. The department chairperson -is concerned with the qualityof i^istruction. ' 

55. Tfie- students treat ebch other as equals. ' •• , 

56. The facility, do not have the^ knowledge td systematically adopt an- innovation. 

57. The students are eager to share experiences and' ideas Vith each ofher. 

58. This department may be avoiding contact with a chan^ agent consulting on one 
of Its projects. ' . 

59. The de^partmental qfforts in seeking out assistance in Implementing innovations 
have been meager?. • . ' ' 

^ 60. There' is mutual trust among members of the faculty. '^ 
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Please rate on a I - 5 scale (as Indicated beJow), how closely each Item describes 
the ,depar^ent;yolj are. rating: 

* ' \ , * . • 

5 - very typical.' 
^ 4 = somewhat typical 

- '/ * ' .3 s natthef typical nor untypical ^ 

. * ^ 2 - spmewhat untypical 

' * 'I = very untypical 

61. Some individual faculty members have made much .progress with respect to an 
innovation. ^ • / 

62. Faculty members are either insecure and/or overly protective of an image. 

63. The faculty members are Interested Fn how innovation can bring about specific 
, changes in their department. ' , ^ 

64. Ei^^her the department chairperson or^, dean is'^ognizant of curriculum develop- 
ment procedures. ^ 

65. Tbe faculty seem ready to commit themselves to adopting innovations. 

66. The faculty are highly interested in innovatlon.^^ 

67. Communications concerning inmovation have all beeo^ enthusiastic and positive. 

^ ' ' 1 • / \ - ^ . . 

68. The studervts'are personally aware. ' ' , ' 

69. Ihe students relate personal problems to faculty members. 

70. The faculty are remote and/or acti ve ly hostl le. 

71. In the past, the high Intare'st of the faculty has resulted In eanly plans 
' toward pilot testing of innovations. " - 

T^.'The'^ean is unwi I j'ili^' to fight with anyone above him/her. 

» * . ^ 

73. An older faculty discourage younger facul^^.-'f^rp^ remaining. ^ - 

74. The faculty like to think of themselves as innovative because they can 
fneatlon s'omfe program names./ '''y}^ • / ' 

75. The faculty lack the ability ^to approach a new situation analytically. 

76. There isjnuch reinforcement for development and imp lementatf^n- of in-^ 
^ novations. . . / Y ^ 
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Please rate on a I 5 scale (as^ indicated below), how closely each item describes 
the department you are rating: 

' ' , * ' * - ' 

5 = very lyphcal . • > 

4 = somewhat typical' 
3 = neither typical nor untypical 
2 = somewhat untypical 
I = very 'untypl cal ; 



77. This department has/deve loped' its own products and;has its own well-de- 

, fined standards for the accept^ce of ' an innovatioil^* ^ 

78. The depar-hrient chai rperson';views most change as a personal affront, 

79. Any material, regarding innovations, made available to the departme7)t, 
~ / 'will probably remain on the shelf unexamined. , 

80. The students are encouraged to develop their own style, 

I 

81. All of the faculty seem equally involved in increasing the level of use 
of previously adopted innovations, ^ 

* • r . 

' 82. Some faculty may already be committed to traditional teaching methods.'/ 



83. Thls^department seems to resent change agent visits.- . 

84* "Cfepartmental efforts to communicate With change agents have not always 
been appropriate. « • ' 

85. Contacts with change agents have been far enough apart that developments , 
carv be evaluated*^ ' ^ 

86. The students are constantly exposed to new ideas. 

87. The departrient chai^rperson views! "the curriculum as the' final word, 

* 88, lofiQ lapses Jn communication may 'occur beiveen the department and change 
aggnts. / " . 

89. The supporters of Innovation have serious communication problems with 
-V the faculty at lar^e* ..;- • . 

There are on^ly we ak^ endorsements Instead of real commitrpents to' any ba- 
sic change within the department. 

LL; The department Qh^ai rperson (or direct supervisor) -Is nbt encouraged in 

*hls ttrrterest in innovation. 

< * V ' 
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Please rate on a I - 5 scale (as indicated below), how cldjsely each item describes 
the ^.department you af"® rating: 



^ = ver)f^typlcal 

4 = somewhat typical 

3 = neither typical nor untypical 

2 = somewhat untypical ^ 

I = very untypical 



92. Personal visits have helped the department ^nd change agents establish 
common goa Is,' 

93. Interested faculty members -are in regular communication with change agents, 

94* This department has had the discipline to follow precisely the directions 
of a developer of an innovation until they have mastered basic skills. 

95. The faculty is hi gh ly. i nvol ved In developing innovations. 

96. The students real Istical ly. assess their own abrilities and needs 

97. The students feel frustrated "^nd dj si I lusioned because of a .lacK of "stan- 
dards" in thei r field. ^ " 

9.8. The students are ,cha I lenged by, innovative developments. 

99. The faculty are interested In teaching tools as. opposed to ideas. 

1 

100, The students are excited about Innovative approaches which compjlimenf 
their'^ipdlvidual I eari^ing styles. * . ' 
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Scorl ng 



Reverse Key Scoring ^ 

The item numbers listed below are reverse-keyed and should have "their rating 
values changed in the following manner: / 

5=1, • - , 

4 = 2' , , 

3=3 (reverse keyed items rated 3, shou'd not 
- be changed) 

-• / ^ 2 = 4". 

"1=5 . ' . . 

For example, i^f you have marked one of the following items a "1^/' it should be 

changed to a "5" for scoring purposes; if youhaVe marked one of the following 

items a "4," it should be changed to a "2" for scoring purposes. 

' The following items should be reverse-keyed: * ^ • 



1 


13 


20 


30 • 


41 


58 


73 ^ 


82 


■ 89 


6 


15 


. 24 


3i ' 


43 • 


59 


74' • 


83 


90 


7 


17 


26 


32 


■ 48 


62# 


75 


84 


91 


9 


'18 


28 


37 


51 


70 


78 ' 


87 


97 


12 


19 


29 . 


40 


56 


72 


. 79 


88 . 


99, 



Deriving Total Spore , 

After the i-fem ratings have been ch^ged as described above; add' up all ratings 

■« 

to the left of items for the^total score. ' 

Deriving Scale. Scores ' , . 

The scafe names and descriptions are as follows: 

Scale I: Orcjanlzational Climate 

(Items in this scale describe the work climate and orgaaizatlonal struc 
ture oi both the department and the^ institution as -a whole J. 

Scale II: Organizational Staff ' , ^ 

(Items in this scale describe personality and leadership styles of 
faculty and admi nistrators wi thi n the department.) 

erIc " - • / 



{ 



Scale III: Communication ' » . 

(Items in-this scale describe communications both within ^the department 

and within the institution as^^whc^lej . ^ 
Scale IV: Innovative Experience s ^ 

(Items in this scale describe a department' s experience with innovatlOTS 

and attitudes towards innovation J 0 ' • ^ 

Scale V: Students t > , 

(Items in this scale describe student behav i or, ^ attitudes, ,;-and demo--^ 
"graphic characteristics.) ' . ^ 

.In order to derive each scale score, add .the ratiVigs of thei r ''respecti ve item, 
numbers listed below: , . 

Scale I : 



Scale II: 



Scale III 



Scale IV: 



Scale V: 











/3 


4 


20 


31 


45 


5 


21 


34 


47 . 


75 


6 


23 


39 


56 ^ 


89 


14 


28 


40 . 


-64 - 


91 


3 


26 


A 1 

41 


oO _ 


lo 


9 


32 


48 


62 - 


•82" 


15 


33 


49 , 


70 . 


87 


22 


35 


54 


72 . 


99 


1 • 


19 


53 


67 - 


88 


7 


• 30 


58 


83 / 


90 


1 1 


36 


59 . 


84 ' 


92 


13 


44 


61 


85 


9? 








■ %> . 




16 


27* 


50 


71 


79 


18 


29 ' 


63 


74 


81 


24 


37 


6^ 


. 76 . 


94 


25 


46- 


66 


77 


95 


2 


17 


51 


68 "' 


96 


8 


\.38 


52 


.69 


97 


10 


42 . 


55 


80 . 


98 



J ' 



12 43 • 57 , 86 100 



Interpretation of Test Scores without U^lng Norms ; * • > 

Since norms have nof yet been deVelopeil for the higher-educational TSC, 
the scoring system outlined above^is., for ^ the time being, primarily demonstrative. 
However, since the items are both emptirically and literature based, they do reveal 
some descriptive information about an institution, l/terns -whi ch are n6t reverse- 
keyed, describe characteristics of-^id^al institutions; items which are reverse-keyed 
describe .characteristics of institutions which are not likely to succeed in the 
adoption/implementation process • '\ 

Normally-keyed items which h^ave received high ratings (ratings of 4 or 5), 
describe i.deal characteristics which can be observed. Conversely; low ratings on 
these items would indicate the extent to which the institution falls short of these 
ideal characteristics. If the reverse-keyed items are examined, high ratings ^ 
(before reverse-keying the items) vill be indicative of an Institution which has ^ 
characteristics inhibiting the adoption and implementation of innovations. Con-- 
versely, tow ratings will describe ch^racteri sti cs .wh ich would b^e positively re- 
lated to the successful adoption of innovations. - 

Items within each scale can be examined In the same manner, for descriptions of 
how the institution stands in relation to each. of the areas described by the scales 
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Scoring Sheet ^ 



TOTAL SCORE 



^ SCALE SCORES: 
SCALE I : 
SCALE ,1 I : 
• SCALE Ml 
SCALE IV: 
SCALE V: 



f 

Organizational Climate 
Organizational Staff 
Communication . 
Innovative Experience 
Students 



SCALE SCORE 
SCALE SCORE- 
SCALE SCORE 
•SCALE SCORE 
SCALE SCORE 
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Appendix C / 
SchooJ-Based TSC Interview! ng. Form 



I am developing a, diagnostic angi predictWe instrument for ^^chools which 
focuses oA assessing the IlkeJihobd of an-y given school, sy^ccessf u I ly adopti ng 
an innovation. Tire; innovation couTd be anything from an entire IGE program 
to a si nglerthfstructional module used in a reading or math program. I am 
-assuming that there are sets of circumstances, conditions, characteristics, etc. 
which exist in order fpr-.any^ "form of change to take place. From the correspon- 
dence that I .have received in response to ^ simi lar .instrument .1^ am. developing 
which focuses on h-ighe'r educational institutions, there appears to be a very 
marked need* for a school-based i nstVument "Whi cTi" wou I d ^ssess ,such a set of 

^ - -• • - - • 

-conditions.- 



I wouTd like to-a'§k'you about what you t^ink are the major characteristics of'_^ 
schools which add .and detract from a school ipj'ts successful adjustment to change. 
I would like you to think -^b.olit jndivi dua I, schools in relation to the school 
system and community. Rather than Jyst asking about the entire picture at 6nce, 
■ will fo^tis-oa one area of the school^envi ronment at a time. For example, I 
wilt first ask about a "Schbol'^ corhtiiunicatipn' system, -and ttien go on to ask 

~ ■ I ■* ' . . ' . . . ; ; • 

,.a&out what types of organizational structures facilitate the change process and 
wh^t^ types detract"?rom ,the process of change, and so' on. 
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Communications , ^ ' \ ■ 

* 

What kind of communication system would be in operation ifi a school' which 
you would consider to be innoVgtive? ^How about a non-innovative school? 
Prompting Examples : Are communications usual ly b^ word of mouth or memo^ 
who initiates communl cations j how is jmportSrit infocmation communi cated— 
th rough informal or formal channels; what could be expected of -commuai cation 
between the particular school and the other parts of the school system— the 
central off.ic'es, school board, and superintendent? - - 

Organ i zati ona I Structure , . ^ ' ' ^ 

How would you describe the organization ^structure atJnnov^tive schools? 
How about nQn-i.rinovati ve schools? - ^ - ^ 

Prompting Questions ; What are unit structures, team structures, and inter- 
disciplinary efforts like? Are team leaders^ subunits and oaraorofessionals 
character! st1 c of this school? - ^ / 

students ♦ How would you describe students in a school system which w^ ideal 
suited for adopting innovatl^"'? 



What about students in schools which are clearly, oon-^innovati ve?* . 



Curriculum Specialists , * . . "* 

What .would be the characteristics of/curri cu I urn -special ists at innovative 

*^ - • • 

schools* — bothtwith respect to their per^sona I , characteristics and thei r role 

in the school? - ' * ' 

Whbt-^about at noh- innovative- schools? . . , ' 
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Counselors. 

^ : — ... . ^ 

What are the counselors like at innovative schools? What Is their role 
In the school? . ' ' - * 

What would the counselors be like at non-i nrjovati ve .schools? 

Central Offices , * - 

How would you describe the central offices at /^nriovatl ve schools? What 
activities should tliey focus on, and how would you describe their function 

/ 

within the school and the school sysfem? 
How about the central offices In pon-i nnovati ve schools? 



Innovative Experience 

r - • " 

What kinds of experiences , do you think innovative schools have had with 
Innovations In the past, and what do you think would be the approach an 

. . \ ■ ■ 

Innovative school would use in impleinenti ng an innpvatibn? 

How about a non-innovative Institution? ^ ' / 

Schoo I /Commun i ty Re I at i ons > ^ 

What kinds of relations would one find between an Innovative school and. its 

community? What about a hon-i nnovatl ve school an'a its community? 

Probe: . Ho\^ well Informed isy^the community about changes, in the 9::hool system? 

What are the sources of funding for the Innovation? How Involved 

^commun^lty in the school system? What Is the per capita Income of^he communiTy? 



Work CI ifnate > How would you describe the work climate.vm an innoVative^ 
school, and in its central offices.. . 
How about a noiv- innovative school? . \ 



Principal . . . 

How would you describe the principal and^his leadersfiFp styleMn l^elatibn' 
to the teachers, the school bpard, superintendent, counselors, curriculum 
specialists and central offices? . * ^ 

What about principals in non-innovative schools? 



Teachers^ ' \ ' . 



What'would ydu expect tfie teachers to be like in arj innoyati ve.schoql? ^ 
What would you expect their role to be irt the school distni.ft? Hovr-do, 
you. think they perceive themsetves? ' ^ - 
What abdi/t, teachers i n*a t>on-i nnovati ve school? 
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V ^ Appendix D ' ' - 

• Sample Items (School Based TSO) 

A cormiunity group exists as a go-between f or 4he school system and the community 
(e.g», an ombudsman,. assessment council, and/or advisory committee). 

Many students at this school are falling. 

The curriculum leaders set expectations in both written and oi;af communicat*ions, 

Th^ innovations which have been' adopted by this particular school are similar to 
the innovations which have been adopted by the entire dis1"rict. ^ 

^ * 

This organization has sufficient personnel, or -will be able to acquire sufficient 
personnel for the sliccessf u I imp lementation. of mnovations. 

Board members communicate often with the superintendent, — *^ 

The school administrator initiates communications with the change agent. 

There are intricate requirements for the appliea^jon for funding, which include 
specific references to^rocedures and evaluation. 

The faculty Is unaware of 'the curriculum specialist and his role. 

m ^ 
This school. is considering innovations that contain easily alterable materials 

capable of meeting the. demands of varied teaching si tuatior?s. 

The research community and'thd school are in constant gommunication with one another. 

Specific problems and needs have been identified by members of this school system. 
The community is high in per capita wealtll. # J ' ^ 



There Is a relatively high expenditure per 
Student tardiness is in the range of avera 



studeht. 



le or 



be low' average in occurrence. 



The curriculum specialists have systematically 
needs of the shcool through direct contact* with 



o 



llected Inforfmation about the 
teachers. 



The carrfculum specfalist Is a "person who has been specif ical ly trained for the job: 
The students seem to. have. .formed- strict cliques among/ themselves . 



